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(54) Error detection in low bit-rate video transmission 

(57) A method for decoding video data blocks using 
variable length codes, comprising transforming informa- 
tion about the spatial frequency distribution of a video 
data block into pixel values. Prior to said transformation, 
a first reference value (Xref) representing the abrupt- 
ness of variations in information about spatial frequency 
distribution within the block is generated, after said 
transformation, a second reference value (A) represent- 
ing the abruptness of variation in certain information 
between the block and at least one previously trans- 
formed video data block is generated. The first refer- 
ence value (Xref) is compared to a first threshold value 
(TH1) and the second reference value (A) to a second 
threshold value (TH2); and as a response to either of 
the first (Xref) and second reference values (A) being 
greater than the first (TH1 ) and respectively the second 
threshold value.(TH2), an error in the block is detected. 




DCT 
check 



34 



Block 
check 



MB cdmpTete ? 



35 



MB 



36 



check \ 



Output 



CM 
< 
CD 



FIG 3 



o 
o> 

o 

LU 



Printed by Xerox (UK) Business Services 
2.16.7 (HRS)/3.6 



1 



EP 0 999 709 A2 



2 



Description 

[0001] The present invention regards video trans- 
mission, and especially a method and device for decod- 
ing compressed video data, wherein information about 5 
the spatial frequency distribution of a video data block is 
transformed into pixel values. 

[0002] One of the targets in telecommunications is 
to provide systems where good quality, real-time trans- 
mission of video, audio and data services is available, w 
As is generally known, the amount of data needed to 
transfer moving pictures is high compared to many 
other types of media, and so far, usage of video in low 
bit-rate terminals has been negligible. Transmission of 
data in digital form, anyhow, has provided for increased 15 
signal-to-noise ratios and increased information capac- 
ity in the transmission channel. In the' near future 
advanced digital mobile telecommunication systems will 
also "be introducing services enhancing the transmis- 
sion bit-rates, which means that transmission of video 20 
even over low bit-rate mobile channels will soon 
become more feasible. 

[0003] For optimisation of channel capacity usage, 
signals are generally compressed before transmission. 
This is especially important with video transmission, '25 
where the amount of data to be transmitted is large. 
Compressed video, is easily afflicted by transmission 
errors, mainly because the information content of com- 
pressed video is generally coded using variable length 
codes. When a bit error alters the codeword to another 30 
one of different length, the decoder loses synchronisa- 
tion and decodes consecutive error free blocks incor- 
rectly until the next synchronisation code is received. 
[0004] ' To limit the degradations in images caused 
by transmission errors, error detection and/or error cor- 35 
rection methods can be applied, retransmissions can be 
used, and/or effects from the received corrupted data 
can be concealed. Normally retransmissions provide a 
reasonable way to protect data streams from errors, but 
long round-trip delays associated with low bit-rate trans- 40 
mission and moderate or high error rates make it practi- 
cally impossible to use retransmission, especially with 
real-time videophone applications/Error detection and 
correction methods usually require a large overhead 
since they add sortie redundancy to the data. 45 
[0005] Consequently, for low bit-rate applications, 
error concealment can be considered as a good way to 
protect and recover images from transmission errors. 
[0006] To be able to conceal transmission errors, ■ 
they have to be detected and localised. The more is so 
known about the type and location of the . error, the bet- 
ter the concealment method can be focused to the prob- 
lem, and accordingly the better image quality will be 
achieved. It is also important to find methods that can 
detect especially those errors that are easily detected 55 
by the human eye. 

[0007] Lately, much interest has been attached to 
error-resilient digital video transmission, but the work 



has mainly been concentrated on digital TV transmis- 
sion using MPEG-2. There the problem is solved mainly 
by adding unique sync codes frequently to the bit 
stream, using short packets with a cyclic redundancy 
check (CRC), and discarding all packets where the CRC 
indicates an error. When the bit-rate of transmission is a 
few megabytes per second, the proportion of frequently 
occurring sync codes or CRC fields in the whole data 
stream is usually acceptable. However, in low bit-rate 
transmission the situation is quite different, and with bit- 
rates of 20-30 kbps the optimisation of overheads is 
extremely important. Furthermore, if the size of the pic- 
ture is for example 704*576 pixels, one 1 6*1 6 pixel mac- 
roblock covers about 0,061% of the whole picture, 
whereas in low bit-rate QCIF (Quarter Common Inter- 
mediate Format) 176*144 pixel pictures, one macrob- 
lock covers more than 1% of the whole image. Hence, 
the loss of a macroblock is more detrimental in low bit- 
rate videophone pictures than in television pictures. 
[0008] The main interest in low bit-rate video coding 
standardisation bodies has been to improve error resil- 
ience of inter coded frames. Most presented methods 
suggest changing of the bit-stream syntax and coding 
algorithms, whereby they can be properly utilised only if 
they are widely supported by users' videophone termi- 
nals. Generally two methods of error detection have 
been put forward: detection of illegal variable length 
coding (VLC) code words, and detection of missing end 
block codes of discrete cosine transform (DCT) matri- 
ces. In practice these methods have been found to be 
insufficient especially for intra coded blocks, since a 
great many VLC errors remain undetected, and errors in 
fixed length coded DC components of intra coded 
blocks are often not detected at all.- Furthermore, errors 
are usually detected far too late, after decoding several 
corrupted blocks. . 

[0009] The publication of Wai-Man Lam and Amy R. 
. Reibman, "An error Concealment Algorithm for Images 
Subject to Channel Errors", in IEEE Transactions on 
Image processing, Vol. 4, No. 5, pp. 533-542-, May 1995 
presents some DCT and pixel domain error detection 
algorithms. These algorithms, however, do not apply 
adequately to low bit-rates and- low resolutions, espe- 
cially due to. the inapplicability of DCT domain algo- 
rithms for the different characteristics of quantised DCT 
matrices. 

[0010] The publication of Aki Hietala. "Virhesie- 
toinen videodekoodaus", Master of Science. Thesis, 
Oulu University, Department of Electrical Techniques, 
1997, presents and analyses some methods for error 
detection in video bitstreams. The methods utilise the 
residual correlation of adjacent pixels- (spatial correla- 
tion) and by detecting anomalies in block boundaries, 
search for corrupted blocks. However, the methods are 
considered rather complex and the achieved effect has 
not yet been sufficient. ... 
[0011] The _ publication of M.R.Pickering. 
• M.R.Frater, J.F.Arnold, and M.W.Grigg, "An Error Con- 
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cealment Technique in the Spatial Frequency Domain", 
Signal Processing, no.54, Elsevier 1996, pp. 185-189 
presents a method for concealing errors that are caused 
by blocks in the image which are similar- in appearance 
to a single DCT basis function. In the method unusually 
large DCT coefficients in the 8*8 block of coefficients 
are detected and reduced to zero. This method works 
well with specific types of transmission errors, but as a 
single means of detection has a limited effect. 
[0012] Now, a new method for decoding video data 
blocks using variable length codes has been invented 
with which the above mentioned drawbacks can be 
reduced. 

[0013] The method according to the invention is 
characterised by generating, prior to said transforma- 
tion, a first reference value representing the variations in 
information about spatial frequency distribution within 
the block; generating, after said transformation, a sec- 
ond reference value representing the abruptness of var- - 
iation in certain information between the block and at 
least one previously transformed video data block; com- 
paring the first reference value to a certain first thresh- 
old value and the second reference value to a certain 
second threshold value; and detecting an error in the 
block, as a response to either of the first and second ref- 
erence values being greater than the first and respec- 
tively the second threshold value. 
[0014] An object of the invention is to provide a set 
of improved error detection elements to be combined 
with different steps of decoding intra coded video data 
blocks. The use of at least two of the error detection ele- 
ments of the invention utilising information in different 
forms and/or "stages- of the decoding process will 
improve the accuracy of error detection and. still not 
unreasonably increase the complexity of the .decoding 
process. The use of error detection according to the 
invention enables enhanced error iconcea-iment proc- 
esses and therewith improves" the error resilience of 
video data transmission at low bit-rates. 
[0015] The invented methods utilise the slowly var- 
ying nature of information in natural pictures by assum- 
ing a relatively high correlation between adjacent 
blocks. Blocks with shapes that are very, improbable in 
nature can .be studied, more carefully. In the methods, 
relatively high correlation is expected between neigh- 
bouring blocks and means for noticing some very abrupt 
variations in bit-streams are presented. An unexpected 
anomaly in the video sequence is interpreted as indicat- 
ing a suspicious or. corrupted block, or a number of 
blocks (macroblock). 

[0016] Furthermore, a device for decoding video 
data is presented. The device comprises means for 
transforming information about the spatial frequency 
distribution of a video data block into pixel values; and it 
is characterized by means for generating, prior to said 
transformation, a first reference value representing the 
variations in information about spatial frequency distri- 
bution within the block; means for generating, after said 



transformation, a second reference value representing 
the abruptness of variation in certain information 
between the block .and at least one previously trans- 
formed video data block; means for comparing the first 

5 reference value to a certain first threshold value and the 
second reference value to a certain second threshold 
value; and means for detecting an error in the block, as 
a response to either of the first and second reference 
values being greater than the first and respectively the 

70 second. threshold value. 

[0017] . The invention will now be described, by way 
of example only, with reference to the accompanying fig- 
ures, of which: 

15 ,. Figure 1 illustrates the phases of encoding and 

decoding intra-coded video images; 
. Figure. 2 illustrates the configuration of a video 

image according to the H.261 standard; 

Figure 3 illustrates the elements of the invented 
20 ... method; 

Figure 4a illustrates the configuration of a DCT 

matrix; 

Figures 4b-4d illustrate different ways of dividing a 
DCT matrix; 

25 . The flow chart of Figure 5a illustrates the principle 
of the first detection element according to the inven- 
tion;. 

. The flow chart of Figure 5b illustrates an embodi- 
■ ment of the method of Fig 5a; 
30-.. " Figure . 6 illustrates the principle of the second 
detection block according to the invention;. 

■ Figure 7 illustrates the principle of an embodiment 
of the second detection block; 

Figure 8a illustrates the principle of the third detec- 
-.35, . tion block according to the invention; Jfc 

Figure 8b illustrates an embodiment .of a third 
• ■, :. . detection block according to the invention;.. 

Figure 8c illustrates another embodiment, of the 

■ method according to the invention; . 

40 ■ • Figure 9 illustrates a functional architecture of an 

embodiment of the invention; 

Figure 10 illustrates an embodiment of a video 
■ ■ . image decoder. according to the invention; and 

Figure 1 1 illustrates an embodiment of.a mobile ter- 
45 minal according to the invention. . 

[0018] . A digital image is formed .by sampling and 
quantising analogue picture information and transform- 
ing the generated data into a continuous stream of bits. 

so The digitised signal allows the use of advanced digital 
. signal processing tools, which permit faster and more 

..: ' efficient data transfer. Several image-coding algorithms 
have recently been developed to reduce the number of 
bits necessary for digital image representation and cor- 

55 respondingly reduce the bit-rates required for transmis- 
sion of digital images. JPEG (Joint Photographic 
Experts .Group) is a widely used algorithm for still 
images, CCITT (ITU Telecommunication Standardisa- 
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tion Sector) recommendation H.261 has been devel- 
oped for videoconferencing. H.263 for videoteiephony 
and MPEG (Moving Pictures Expert Group) for transfer- 
ring and storing moving video pictures. The block dia- 
gram of Figure 1 illustrates the basic stages of video 
encoding and decoding used in these standards and 
generally known to a person skilled in the art. The digital 
image data is divided 11 into small blocks comprising a 
certain number of pixels (e.g. one block contains 8x8 
pixels). The data in each block is transformed into the 
spatial-frequency domain using the Discrete Cosine 
Transform (DCT) 12. The derived DCT matrix is quan- 
tized 13 and the quantized signal is coded using a table 
of Variable Length Codewords (VLC) 14. The coded sig- 
nal is transmitted to the receiver. At the receiving end 
the inverse processes 15, 16 and 17 are implemented in 
a- reverse order to reconstruct the image. . - - 
[0019] The resolution of a digital image is defined 
by the number of pixels in the picture matrix. Sampling 
with 8 bits for each of one luminance (Y) and two 
chrominance components (U ( V) results in. 2 24 ~16 mil- 
lion available colours. The human visual system is more 
sensitive to luminance than chrominance components, 
so generally the chrominance components of the pic- 
ture are spatially undersampled. For example in ITU-T 
H.261 recommendation, for every four luminance blocks 
two chrominance blocks are used. As illustrated in Fig- 
ure 2, sets of 4 luminance and 2 chrominance blocks 
. form a macroblock 21, and an H.261 image 23 com- 
prises 1 2 block groups 22, that are formed by 3x1 1 mac- 
roblocks. Corresponding structural grouping systems 
are used in other coding standards. 
[0020] The flow chart of Figure 3 illustrates the ele- 
ments of the invented method in connection with the 
steps of decoding a macroblock. The invention is based 
. on the idea that blocks are an artificial way to divide 
information, and therefore in low / bit-rate " video 
sequences variations of natural images between blocks 
should occur slowly and/or within certain limits in an 
expected manner. The method comprises three sepa- 
rate detection elements, of which at least two are com- 
bined with the decoding process of variable length 
decoding 31 , inverse quantization 32 and inverse DCT 
33. The detection elements utilise available information 
at the different levels of decoding to detect transmission 
errors. The first detection element 34 performs steps for 
inspecting block level DCT components, and 1 it can be 
performed either before of after inverse quantization. 
For the purposes of the second and third detection ele- 
l e nt s, the DCT compo n ents' of the current macroblock 



or results from studying more components as well. In 
the following, the detection elements of Figure 3 will be 
studied in more detail. 

5 1. First detection block (34) 

[0021] After a discrete cosine transform, a pixel 
block can be presented as a DCT matrix comprising a 
DC coefficient and a plurality of AC coefficients, zigzag- 

w scanned from lower to higher frequency coefficients as 
shown in figure 4a. In practice, it is highly improbable 
that there would be large amplitudes in high frequency 
AC components in low-resolution pictures. However, 

• • large amplitudes are possible, and in the invented 

15 method they are not simply filtered out, but are used to 
detect errors by appreciating the tact that high fre- 
quency AC components should have smaller absolute 
values than the lower frequency AC coefficients. 
[0022] • The flow chart of Figure 5a illustrates the 

20 principle of the first detection element by a simplified 
method to check the. validity of a DCT matrix. In step 
510 the AC components of the DCT matrix are divided 
into at least two groups, where certain higher frequency 
components AC36-AC63 (ref: Figure 4a) form a first 

25 group and a second group "is a selected set of the 
remaining AC components-(later referred to as low fre- 
quency components). At least one first threshold value 
TH1 , representing the activity in the lowerfrequencies is 
calculated from the AC components of the second 

30 group (step 520). Furthermore, at least one reference 
value Xref is calculated in step 530. The reference value 
represents the magnitude of non-zero coefficients, for 
example of the AC components of the first group or of 
the AC components of the second group. The reference 

35 value- Xref is compared (step 540) to the derived first 
threshold value TH1, and if the reference value is 
greater than the threshold value (step 560), it means 
that an error is detected. 

[0023] The flow chart of Figure 5b illustrates an 
40 embodiment of the method in Figure 5a, in which actu- 
ally two first reference values and corresponding first 
threshold values are generated. In step 511 the DCT 
matrix is divided into horizontal, vertical, diagonal and 
.high frequency bands. Exemplary horizontal, vertical 
45 and diagonal bands, further referred to collectively as 
low frequency bands, are illustrated in figures -4b, 4c, 
and 4d respectively There can be - some overlap 
between these low frequency bands. In step 512 the 
first low.frequency band k is chosen. The absolute sum 
so abSum k of the coefficients, the greatest absolute coeffi- 



are temporarily stored e.g.' to a' volatile memory of the 
decoder/The second detection element 35 performs 
steps for block level spatial comparison, and the third 
detection element 36 performs comparisons at the mac- 
roblock level. For detection, only corresponding compo- 
nents are compared with each other (i.e. Y- U-, and V- 
components separately). The interpretation of detection 
can rely on results from studying only one component, 



cient value AC max k and the number n k of non-zero fac- 
tors of abSum k are calculated in step 513. !n step 514 
the number of non-zero coefficients in the low frequency 
band k is checked, and if there is more than one non- 
55 zero coefficients in the band, the coefficient with the 
greatest absolute value AC maxk is subtracted from the 
absolute - sum of the \ other non-zero coefficients 
abSum k , and the sum is added to a predefined constant 
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value C-,. The attained sum is defined 521 as an auxil- 
iary first threshold TH1a. If there is only one or no non- 
zero coefficients, the auxiliary first threshold value TH1 a 
is defined 522 to be the predefined constant value C-|. In 
step 541 the greatest absolute coefficient value AC max k 
(first reference value) is compared to the first threshold 
value THIa, and if the first reference value AC^ ax k is 
greater or equal than the first threshold value TH1a, an 
error is detected 560. If the first reference value ACm^ 
is' smaller than the first threshold value TH1a, it is 
checked 542, whether all low frequency bands have 
already been examined. If not, the next one is chosen 
(step 543). ' 

[0024] When all the low frequency bands have been 
examined, the high frequency band is also studied. In 
step 544 a second first threshold is derived from the 
absolute values of coefficients in the' low frequency 
bands by choosing TH1b=max(C 1 , AC max k ; k=.1...K). 
After this.Uhe first coefficient j of the high frequency 
band is examined (step 545). The first reference value 
now Xref is the absolute value of the chosen high fre- 
quency coefficient, and if the Xref is greater than the 
threshold TH1 b (step 546), an error is detected (step 
560). The loop (steps 546-548) is repeated until all the 
components in the high frequency band have been 
studied. If neither of the thresholds TH1 a and TH1 b are 
exceeded in the process, the method indicates (step 
550) that no errors have been detected in this block at 
this stage. '"' - 

2. Second detection element ( 35) 

[0025] As already mentioned, variations between 
neighbouring' blocks in natural pictures tend to progress 
relatively smoothly. Consequently, the operation of the 
second detection element is based on monitoring corre- 
lation between neighbouring blocks/ Preferentially, the 
second detection element is'i-ncluded in the decoding 
process after the inverse discrete cosine transform. For 
the purposes of the' second and third detection ele- 
ments, the DCT components of the current macroblock 
are temporarily stored, e.g. to a volatile memory of the 
decoder. The flow chart of Figure 6 illustrates the princi- 
ple of the second detection element according, to the 
invention. - 

[0026] In step 610 a reference value Xcurr is 
derived from the information of the. current block. The 
reference value Xcurr represents a feature that presum- 
ably continues- over the block boundaries, and can be 
derived in several ways, as will be shown later. In step 
620 a corresponding reference value Xneigh is derived 
from the information of at least one neighbouring block, 
in step 630 the reference values are 'compared with 
each other in order to derive a difference value repre- 
senting the variation A of the studied feature when mov- 
ing from block to block. If the variation is larger than a 
second threshold TH2 (step 640), an error is detected 
(step 660). If the variation does not exceed the second 



threshold TH2, no error is detected (step 650). The sec- 
ond threshold TH2 can be e.g. a predefined constant. 
[0027] In an embodiment of the invented method, 
the reference value Xcurr is the DC component of the 

5 block; Only previously decoded blocks -are available for 
comparison. If the error checking method is used during 
decoding, the DC components in blocks to the left, 
above, above-left an-d above-right are available for com- 
parison. If the check is done only after the whole frame 

w is decoded, possible neighbours for some blocks can 
also be found in the row below the current one. If the dif- 
ference between the current block and every available 
' neighbouring block is larger than a certain threshold, an 
error in the current block is detected. In practice, the 

is threshold should be rather high, since in low resolution 
images' the contents of two adjacent blocks can be quite 
different. Anyhow, this check requires only a few com- 
parisons and storing of DC components, and therefore 
does not add much complexity to the decoding process. 

20 [0028] . In another embodiment of the invented 
method, the studied block is divided into a number of 
• sub-blocks (for example an 8*8 block is divided into four 
4*4 sub-blocks). For each sub-block the average of the 
pixel values is calculated and the calculated value is 

'25 used as the reference value Xcurr for that sub-block. As 
. a reference value of the neighbouring block Xneigh, the 
averaged pixel value of the neighbouring sub-block in 
left, above,, above-left and above-right directions in 
turns, are used. The variation A equals the difference 

30- between, the reference value Xcurr and the averaged 
■ pixel value Xneigh of each of the studied neighbouring 
sub-blocks. If the difference A for a sub-block and any of 
. its studied neighbours is greater than a predefined sec- 
- ond threshold TH2, an error is detected. Anyhow, if such 

35 - interpretation in this case seems too strong, the block 

- , . can be marked suspicious, and the check can be sup- 
plemented with some other check. 
[0029] . . In another embodiment of .the invented 
method, pixels in the block boundary are used to check 
• 40 [he continuity of the image. In prior art solutions, only 
pixels immediately in the block boundary, are studied, 
but in practice, this has not proved to be enough. In an 
enhanced .me.thod, the gradient. of changes, in pixel val- 
ues close to the boundary is also taken into .account. 

45 The principle of such an embodiment- of Jhe second 
detection block is illustrated in Figure 7. 
[0030] In Figure 7a a boundary 70 between two 

. . . adjacent blocks 71 and 72 is shown. Point 73 represents 
the- value of a chosen component (e.g. luminance) of 
- so . the pixel of the first block 71 closest to the boundary 70. 
" Point. .74 represents the value of the same component 
• for a- pixel of the second block 72 closest to the bound- 
ary and in the same row as the pixel of point 73.. Point 75 
represents the value the" same component for a pixel of 

55 the first block 71 situated next to the boundary pixel 73 
and farther away from the boundary. 70. Point 76 repre- 
sents the value of the same component for a pixel of the 
second block 72 situated next to the. boundary pixel 74 
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and farther away from the boundary 70. First, the differ- 
ence d1 between values of boundary pixels 73 and 74 is 
derived. Then, values 77 and 78 are extrapolated from 
the values of points 73/75 and 74/76 respectively. The 
difference d2 between the extrapolated values, is calcu- 
lated, and the differences d1 and d2 are compared with 
each other. The smaller of them min(d1 , d2) is added to 
a cumulative sum A calculated for the boundary 70 of 
the block 71 . The total sum A is compared with a prede- 
fined second threshold TH2, and if the sum A is greater 
than TH2. the other boundaries are checked similarly. If 
the sums of all boundaries exceed TH2, an error is 
detected. In this example the luminance component is 
used for calculations, but generally any of the luminance 
and chrominance components (Y. U, V) can be used, 
and/or the check can be implemented for each of the. 
components separately. The criterion can also be mod- 
ified to indicate an error if the sum of one/two/three 
boundaries show values exceeding TH2. In Figure 7b 
the same arrangement as in Figure 7a, but with different 
pixel values and a different direction of change is pre- 
sented. With extrapolation, unnecessarily hasty conclu- 
sions about the validity/non-validity of the block can be 
avoided. 

[0031] In the prior art literature some edge detec- 
tors for block boundaries have been presented. The 
embodiments shown here can be supplemented with 
the use of such edge detectors, e.g. compass gradient 
operators. 

3. Third detection element (36) 

[0032] At the macroblock level information about a 
plurality of blocks can be studied and deviations 
between blocks can be examined in more detail. For the 
purposes of macroblock check, all or a chosen set of 
DCT components of the macroblock will be stored in a 
volatile memory of the decoder. The flow chart of Figure 
8a illustrates the principle of detection methods at the 
macroblock level. In steps 810 and 820 the first block B, 
is received and a certain macroblock level parameter qj 
representing the feature whose variations are examined 
throughout the macroblock is stored in a memory 830. 
Information is gathered with the progress of loop of 810- 
850 until the counter j reaches the value J (step 830), 
which equals the number of blocks in the macroblock. 
When the whole.macroblock has been received and the 
parameters q s for ali blocks are stored, a* reference value 
or a set of reference values Qcurris derived 860 from 
the-para meters qj-Qcurr is-checke.oL 870 against a third 



most of the visually noticeable shape information of a 
frame can be found in the luminance component. Con- 
sequently, if there are small changes in luminance 
blocks, not many changes should occur in chrominance 
5 blocks of the macroblock either. This is especially true if 
the image is sampled e.g. using 4:2:0 format (i.e. four Y- 
blocks with one U-block and one V-biock). The flow 
chart of Figure 8b illustrates such an embodiment of a 
method according to the invention. 
10 [0034] Steps 810-850 follow the process illustrated 
with Figure 8a, except'that in step 831 the parameter q m 
represents the variations of the values of the AC coeffi- 
cients in U, V, and Y blocks (AC U m , AC Vm . AC Y , m ) of the 
macroblock. In step 861 values AC y M and AC VM repre- 
15 senting the amount of variation of AC components in U- 
and V-blocks is derived, and they are processed into a 
value TH3 representing the third threshold. In step 862 
a corresponding reference value AC Y ,j representing the 
variation of AC components in the. luminance (Y) blocks 
20 is derived and processed into a third reference value 
Qcurr. In block 871 the reference value Qcurr and the 
threshold value TH3 are compared with each other and 
if the threshold based on variations in chrominance 
components (U and V) is much bigger than the refer- 
25 ence number based on variations in luminance (Y) com- 
ponents (step 880), the macroblock is. considered 
corrupted (step 895). Otherwise no errors are detected 
(step 890) at the macroblock level. Another possibility is 
e.g.. to study the variation in. the DC-components of U- 
30 and V-blocks against the variations of the Y-components 
in comparison to some earlier decoded macroblock. If 
e.g. variation in U- and.V-block DC-components exceed 
one auxiliary third threshold, and variations in Y-block 
DC-components do not exceed-another auxiliary third 
35 threshold, an error is detected. ... - ♦ 

[0035] The flow chart of Figure 8c illustrates 
.another -embodiment of the method according to the 
invention. The parameters to store in : step 832 of the 
receiving loop are .the DC components of the.macrob- 
40 lock and an absolute sum of. AC components of the 
macroblock. In step 863 the. magnitude of variations in 
the DC-components throughout the macroblock is cal- 
culated and the absolute sum - of AC components 
needed to account for the variations of the DC compo- 
45 nent is estimated. The estimated sum is used as a third 
threshold value TH3, and the actual .variation in DC 
components is used as a third reference value. If the 
. DCrComponents are varying noticeably and the AC 
coefficients are not enough to smooth the changes, the 
• 50 -compatibility of the coefficients, is questionable (step 



threshold TH3 representing a limit set for Qcurr to fulfil 
certain predefined criteria. In case the reference value 
Qcurr is less than the third threshold TH3. no error is 
detected (step 890). If the reference value exceeds 
TH3, an error is detected (step 895). 
[0033] In an embodiment of the method as shown in 
Figure 8a, the reference values and the checking crite- 
ria are based on local spectral correlation. In practice, 



872). By comparing the reference value Qcurr to the 
threshold value TH3 (step 880), the macroblock can be 
interpreted to be corrupted (step 895) or not (step 890). 
[0036] The method herein has been presented at 
55 the macroblock level, but macroblocks can also be 
checked in rows. In the very first row of a video frame, 
•there are. not many neighbouring blocks or macroblocks 
available for comparison. If there are no abrupt changes 
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in the first row and the values fall within a typical range, 
they can be considered uncorrupted. If there is any 
doubt, the values of the first row should be checked 
together with the second row. If the values of the first 
row are very different from the values in the second row, 
and the values of the second row do not contain any 
abrupt changes, the first row is probably corrupted. 
[0037] The flow chart of Figure 9 illustrates the 
functional architecture of an embodiment of the inven- 
tion, where ali three presented elements are included in 
the decoding process. First the method(s) 90 for check- 
ing the DCT components within blocks are implemented 
and the corrupted blocks are filtered out therewith. Even 
for the blocks that pass the DCT check a block check 91 
is performed. Corrupted blocks are again filtered out, 
and suspicious blocks (i.e. blocks that have failed detec- 
tion methods that do not detect errors but mark suspi- 
cious bldcks>are forwarded for macroblock .checking 92. 
Blocks thaKpass DCT check and block check and/or 
macroblock s check are forwarded normally 93, and the 
blocks that fail any of the checks are forwarded with an 
error indication for initiation of error concealment meth- 
ods. 

[0038] The block diagram of Figure 1 0 illustrates an 
embodiment of a video image decoder 100 according to 
the invention. The decoder comprises an input port 101 
for receiving video image information in the form of var- 
iable length codes, and an output port 1 02 for outputting 
processed video image information. The decoder fur- 
ther comprises at least one processor 103 for imple- 
menting the steps of decoding presented in Figure 1. A 
-processor of a decoder according to the- invention is fur- 
ther arranged to include at least two of the three pre- . 
sented detection blocks in the decoding process, and 
whenever justified, to add an indication of a'detected 
error to the output video image information. The proces- 
sor is also arranged to initiate a predefined .error con- 
cealment process as a response to a detected error in a 
: decoded block or a macroblock. The memory 104 com- • 
prises at least a volatile memory for saving data during 
the decoding process. 

[0039] The functional . block diagram of Figure 11 
illustrates a generic mobile multimedia videophone ter- 
minal according -to the invention. The terminal com- 
prises a radio frequency unit 110 generally comprising 
means for transmission 1 (e.g. channel coding, interleav- 
ing, ciphering; modulation and radio transmission) and 
for receiving (radio receiving, demodulation, decipher- 
ing, and channel decoding), a duplex filter and an 
antenna. The received synchronous bit stream is sent to 
the multiplex/demultiplex protocol unit 111 of the termi- 
nal. The Multiplex protocol multiplexes transmitted: 
video, audio, data and control streams into a single bit 
stream, and demultiplexes a received bit. stream into 
various multimedia streams. In addition, it performs log- 
ical framing, sequence numbering, error .detection, and 
error correction, as appropriate to each media type. The 
control protocol 112 of the system control 113 provides 



end-to-end signaling for operation of the multimedia ter- 
minal, and signals all other end-to-end system func- 
tions. It provides for capability exchange, signaling of 
commands and indications, and messages to open and 

5 . fully describe the content of logical channels. -The data 
. protocols 1 14 support data applications 115 such as 
electronic whiteboards, still image transfer, file 
■ exchange, database access, audiographics conferenc- 
ing, remote device control, network protocols etc. The ^ 

; 0 - audio .codec 116 encodes the. audio ■ signal from the 
.audio I/O equipment 117 for transmission, and decodes 
the encoded audio stream. The decoded audio signal is 
played using audio I/O equipment 1 1 7. The video codec 
. 118 comprises a video encoder 119 and a video 

75 decoder 100, and carries out redundancy reduction 
coding and decoding for video streams to and from the 
videO'.l/O equipment 120. The terminal accoring to the 
invention comprises a video decoder 100 as described 
earlier in connection with Figure 10. 

20 [0040] ; The above is a description of the realization 
of the invention and its embodiments utilizing examples. 
It is' self-evident to a person skilled in the art that the 
invention is not limited to the details of the above pre- 
sented embodiments and that the invention can also be 

25 realized in other embodiments without deviating from 
the characteristics of the invention. Especially the crite- 
ria for the decision of detected error and the choise of , ^ 
threshold can be adjusted in many ways according to 
the application. The presented embodiments should 

30 therefore be regarded as illustrating but not limiting. 
Thus the possibilities to realize and use the invention 
are limited only by the enclosed claims. 

' , * , .. *\ 

Claims * s 

" 35 ■ ' . % , £ 

..1. A method for decoding compressed video data 

•comprising: 

transforming information about the spatial fre- 
40 ■ quency distribution of a. video data block into 

■ pixel values; and characterized by, 
generating, prior to. said transformation, a first 
reference value (Xref) representing the varia- 
- tions in information about spatial frequency dis- . 
• 45 . .tribution within the block; ... 

generating, after said transformation, a second 
reference value (A), representing the abrupt- 
ness of variation in certain information between 
the block and at least one previously trans- 
50 formed video data block; . 

.comparing the first reference value (Xref) to a 
certain first threshold value (TH1) and the sec- 
ond reference value (A) to a certain second 
threshold value (TH2); and 
55 detecting an error in the block, as a response to 

either of the first (Xref) and second reference 
values (A) being greater than the first (TH1) 
and respectively the second threshold value 
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(TH2). 

2. A method according to claim 1 , characterized by 

generating, after decoding a number of blocks 
forming a macroblock, a third reference value 
(Qcurr) representing the abruptness of varia- 
tions in certain information within the macrob- 
lock; 

comparing the third reference value (Xref) tc a 
certain third threshold value (TH3); 
" detecting an error in the macroblock, as a 
response to the third reference value being 
greater than the third threshold value, 

3. A method according to claim 1 or 2, characterized 
by generating, after decoding a number of blocks 
forming a macroblock, a third reference value 
(Qcurr) representing the abruptness of variations in 
certain information between the macroblock and at 

■ least one previously decoded macroblock; 



5. 



comparing, for each of the sets, the first refer- 
ence value (AC max k ) of the set with the first 
threshold vaiue(THIa) of the set; and 
detecting an error in the block, as a response to 
5 any of the first reference values (AC maxk ) of 

the set being greater than the corresponding 
first threshold value (TH1a) of the set. 

7. A method according to claim 6. characterized in 
w that said first reference values are the greatest 

absolute coefficient values (AC maxk ) of a set of 
DCT coefficients, and the first threshold values 
■ comprise a predefined constant value {C^) added, 
as a response to the number of non-zero coefficient 
15 ' values being greater than one, to the absolute sum 
(abSUM k ) of the coefficient values excluding said 
greatest absolute coefficient value (AC maXik ). 

8. A method according to claim 1 or 2, characterized 

20 by: 



comparing the third reference value (Xref) to a 
certain third threshold value (TH3); and 
detecting an error in the macroblock, as a 25 
response to the third reference value being 
greater than the third threshold value. - 



generating a second reference value (A) from 
the difference or differences between the DC 
components of the current block (Xcurr) and of 
at least one previously transformed block 
(Xneigh). ■ 



A method according to claim 1, 2 or 3, character- 
ized by initiating, as a response to the detected 
error, an error concealment process. 



A method according to claim 1, characterized in 
that said transformation is an inverse DCT transfor- 
mation of the block, and the method further com- 35 
prises: 



dividing DCT .coefficients of the block into at 
least two parts, wherein the coefficients of the 
first part are associated with higher frequen- 
cies than the coefficients of the second part; 
generating a first reference value (Xref) from 
the coefficients (ACj) of the first part; and 
generating a first threshold value (TH1b) from 
the coefficients of a set of coefficients not 
belonging to the first part. 



6. A method according to claim 5, characterized in 
that the method further comprises: " ' * 



9.. A method according to claim 1, characterized in 
said generation of the second reference value com- 
30 prising:. 

dividing each block .into a certain number of 
, sub-blocks; , 

calculating the average .oUhepixel values for 
the sub-blocks: and 

generating a second reference value (A) from 
the difference between the. averaged pixel val- 
ues of the current sub-block and at least 
another neighbouring sub-block. 

10. A method according to,,claim-1, characterized in 
that each video, data block comprises a number of 
; pixels arranged in rows, and boundary pixels (73, 
74) are the pixels closest to the boundary (70) 
between two blocks, wherein . said generation of the 
second reference value comprises, for a boundary 
(70) of a block: . . 

- • calculating a first difference value (d-1) repre- 
50 senting the difference between the pixel value 



40 



45 



of the boundary pixel (73) and the pixel value of 
the closest boundary pixel (74) in the same row 
of the adjacent block; 

calculating extrapolated boundary pixel values 
(77,78) from the boundary pixels (73, 74) and 
the closest pixel in the same row of the same 
block (75, 76); 

calculating a second difference value (d2) corn- 



forming at least two sets of DCT coefficients 
from the coefficients not belonging to the first 
part; 

generating a first reference value (AC max k ) for 
each formed set of DCT coefficients; 
generating a corresponding first threshold 
value (TH1a) for each formed' set of DCT coef- 
ficient's; 
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' prising the difference between the extrapolated 

boundary pixel values (77, 78); 
comparing the first (d1) and second difference 
values (d2); • 

adding the smaller of the first and the second 5 
values to a sum of differences calculated in the 
same way for all pixels in the boundary (70) of 
the block; and 

" generating, for each block boundary, a second 

reference value (A) from said sum of differ- 10 
ences of all pixels in the boundary. 

11. A method according to claim 2 /characterized by 

dividing the AC coefficients of the macroblock is 
into groups of values (ACy j AC V j, AC Y j) of at . 
!east-U-blocks; V-blocks and Y-blocks; 
generating sets of values (AC y J( AC V J( AC Y j) 
representing the variation in the AC values of 
U-, V-, and Y-blocks in the macroblock; 20 
generating a third reference value (Qcurr) from 
the magnitude of variations in U- and V-compo- 
nents (AC UJt AC V j); and 
■ f • : generating a third threshold value (TH3) from 

the magnitude of variations in the correspond- 25 
ing Y-component (AC Yi j). 

12; A method according to claim 3, characterized by 

generating the third reference value (Qcurr) 30. 
from the differences between the DC values of 

' 1 U-, and V-blocks in the macroblock and in at 

least one previously decoded macroblock; and - : 
generating a third- threshold value (TH3) from .. •.- 
the differences between the DC values of Y- -35 

' • blocks in the macroblock and in at least one 
" previously decoded macroblock. 

13, A method according to- claim 2, -characterised by 

. . 40 > 



' generating the third reference value from the. 
absolute sum of values of AC coefficients in a 
•* " number of blocks in a macroblock; and 

generating the third threshold value (TH3) from - 
- '■ ■' the estimated sum of values of AC coefficients 45 
needed to account for the variation in DC coef- 
ficients in said number of blocks. " 

14. A method according to claim 2 or 3, characterised 

by - 50 

marking the blocks- as suspicious, as a*- • 
response to either of the first and second refer- 
ence values being greater than the first and 
respectively the second threshold value; and 55 
initiating further detection for macro blocks 
comprising at least one block marked as suspi- . 
cious.' ' : ' 1 ■ 



15. A device (100) for decoding compressed video 
data, comprising: 

means (103) for transforming information about 
.. the spatial frequency distribution of .a video 
data block into pixel values; and characterized 
> by 

means (103) for generating, prior to said trans- 
formation, a first reference value (Xref) repre- 
t . senting the variations in information about 
■spatial frequency distribution within the block; 
• - means (103) for generating, after said transfor- 
. mation,- a second reference value (A) repre- 
, senting the abruptness of variation in certain 
information between the block and at least one 
.previously transformed video data block; 
. ; means (103) for comparing the first reference 
..value (Xref) to a. certain first threshold value 
\(TH1) and. the second reference value (A) to a 
certain second threshold value (TH2); and 
means ( 1 03) for detecting an error in, the block, 
as a response to either of the first (Xref) and 
.second reference values (A) being greater than 
• the first (TH1) and respectively the second 
-.1. threshold value (TH2). • 

16. A device according to claim 15, characterized in 
that the device further comprises 

means (103) for generating, after decoding a 
number of blocks forming a macroblock, a third 
reference value (Qcurr) representing the 
. *.. abruptness of variations in certain information 
within the macroblock; ... , 
means (103) for comparing the third reference 
value (Xref) to a certain "third threshold value 
(TH3); and 

rneans (103) for detecting an error in the mac- 
roblock, as a response to the third reference 
. . ■ value being, greater than the. third threshold 
. : *. value. - . , 

-17. A device according to claim... 15 or 16, character- 
.- ized in. that the device further comprises 

means (103) for initiating, as a response to the 
detected error, an error concealment process. 

18. A device according- to any of the, claims 15 to 17, 
characterized in that it is a mobile terminal (MT). 
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